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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re Application of. 
Jia Hong Yin 

U.S. Serial No.: To be assigned 
International Application No.: PCT/GBOO/00989 
International Filing Date: 16 IVIarch 2000 
International Priority Date: 16 March 1999 

Title: CLOSED CIRCUIT TELEVISION (CCTV) CAMERA AND SYSTEM 

PRELIMINARY AMENDMENT 

Box PCT 

Director of the US Patent & Trademark Office 
Washington, DC 20231 

Dear Sir: 

Prior to action in, and calculation of fees for, the above-captioned 
application, please amend the application as follows: 

IN THE SPECIFICATION: 

Kindly amend the specification as follows: 

Clean Specification 

Page 1 : 

CLOSED CIRCUIT TELEVISION (CCTV) CAMERA AND SYSTEM 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to a closed circuit television (CCTV) 
cameras and systems, and more particularly to multi camera CCTV systems. 
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2. Background 

Such multi camera CCTV systems may include tens or even 
hundreds of cameras. IVlonitors are installed remote from the cameras and are 
usually watched by operators in a central control room or monitoring centre. 

Page 2: 

SUMMARY OF THE INVENTION 

According to a first aspect of the invention there is provided: a 
camera having means for determining whether information detected in its field of 
view includes a moving object; processing means for determining whether said 
moving object exceeds a predetermined threshold; and means for transmitting at 
least a portion of said moving image to a remote location. 

Page 4: 

BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments of the invention will now be described, by way of 
example only, and with reference to the Figures, in which: 

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

Figure 1 shows a block diagram of a camera 2, which includes 
Processing Unit 10 and MPEG 4 encoder 4. An actuator 8 is provided to move 
camera 2 in a controlled manner, eg, by tilting, panning or zooming. Processing 
unit 10 is shown in greater detail in Figure 2. 



2 
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Version with Markings to Show Changes Made 

Page 1 , below the title, please insert lieading BACKGROUND OF 
THE INVENTION -; 

Page 1, above line 5, please insert heading - 1. Field of the 

Invention --; 

Page 1, above line 8, please insert heading 2. Background -; 
Page 2, above line 2, please insert heading - SUMMARY OF THE 
INVENTION --; 

Page 4, above line 15, please insert heading - BRIEF 
DESCRIPTION OF THE DRAWINGS --; 

Page 4, above line 30, please insert heading -- DETAILED 
DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS --. 



IN THE CLAIMS: 



Kindly amend the claims as follows: 

Clean Set of Claims 

3. A camera according to claim 1 wherein the camera has an 
actuator arranged to tile, pan or zoom, 

4. A camera according to claim 1 wherein at least one motion 
sensor is included so that images are transmitted only if movement is detected. 
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Version with Markings to Show Changes Made 

Claim 3, line 1 , delete "or 2"; 
Claim 4, line 1 , delete ", 2 or 3". 
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REMARKS 



By the amendment, the multiple dependencies have been removed 



from dependent claims 3 and 4 so that each claim depends from a single claim 
and to avoid the fee charged for such claims as originally presented. 



Manelli Denison & Salter PLLC 

2000 M Street, NW 
Suite 700 

Washington, DC 20036-3307 
TEL. (202) 261-1020 
FAX. (202) 887-0336 



Dated: September 6, 2001 



Respectfully submitted, 




William H. Bollman 
Reg. No. 36,457 
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CLOSED CIRCUIT TELEVISION (CCTV) CAMERA AND SYSTEM 

5 The prescni invention relates to a closed circuit television (CCTV) cameras and 
systems, and more particularly to multi camera CCTV systems* 

Such multi camera CCTV systems may include tens or even hundreds of cameras. 
Monitors are installed remote from the cameras and are usually waxched by operators in 
10 a central conur^ol room or monitoring centre. 

Multi camera CCTV systems are used increasingly to improve security and safety in a 
myriad applications, including offices, car parks, shopping malls, on motonvays, 
railways, and airports. 

15 

Analogue images obtained by the cameras may be transferred to the monitoring centre 
by cable which is connected to each camera. The installation of cables may be costly, 
or may not be practical for some situations where, for instance, only mobile cameras can 
20 be used. In such situadons CCTV systems send images via a radio frequency (RF) link. 
Such RF links have limited bandwidth and therefore limit the amount of cameras which 
may be used in any one system. 

Large amounts of data are produced from digital cameras. Data compression techniques 
25 therefore may be used in wireless (RF) CCTV monitoring systems. However, even 
these were not able to allow ail cameras to transmit at the same time. Therefore 
operators have had to switch sequentially from one camera to the next in order to 
monitor premises or check what was happening at a particular location, 

30 A problem has been that sometimes an event has occurred at a location which was not 
being viewed at the time an event occurred. 



The present invention arose in an attempt to overcome this and associated problems. 
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According to a first aspect of the invention there is provided; a camera having means for 
detennining whether information detected in its field of view includes a moving object; 
processing means for determining whether said moving object exceeds a predetermined 
5 threshold; and means for transmitting at least a portion of said moving image to a 
remote location. 

The means to obtain information preferably includes a charge coupled device (CCD) 
and a microprocessor arranged to discriminate between static and moving pixels or 
10 moving portions of an image. Means may be provided to modify a signal so that it is 
prioritised over another signal. Thus one or more cameras are configured and/or 
switched automatically to send image data to a monitoring centre when there is an event 
of interest occurring in the field of view of a camera. 

15 According to another aspect of the present invention there is provided a Closed Circuit 
Television (CCTV) system including a plurality of CCTV cameras and a 
communication channel from each of said cameras to at least one monitor; characterised 
in that means is provided at a camera to obtain information indicative of displacement 
of an object in the camera's field of view and processing means is provided to 

20 determine whether said information exceeds a predetermined threshold, whereby if said 
threshold is exceeded an override signal is generated, which override signal switches the 
monitor to receive from said camera. 

Each camera may be incorporated with a motion or infra red sensor so thai images are 
25 transmitted only if movement is detected. Cameras may be adapted to follow or track a 
moving object. If an infra red motion detector is used to detect presence of an object in 
a camera's field of view, this may be configured to act as an initial warning or alert that 
activity is occurring in a particular camera field of view. This information may be used 
as an initial prioritisation of a transmitted signal and switch a monitor accordingly. In 
30 addition a higher priority may be accorded by the processing means and means for 
determining whether a predetermined threshold is exceeded. This is because the higher 
priority has associated with it a quantitative element. Thus, for example, the former 
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embodiment may be activated by animals such as birds or cats; whereas when 
combined with the latter embodiment discrimination of such events is provided. 

Means may also be provided to detect areas of interest and/or to obtain information 
5 indicative of features in the images. Preferably means is provided to determine whether 
said information contains data indicative of any events of interest for the purposes of 
surveillance and monitoring. If said data is obtained and/or exceeds a predetermined 
threshold, an override signal is generated, which override signal switches a transmitter 
to transmit the image data of said camera to a monitor. The invention enables one or 

10 more portions of an image frame to be transmitted, if for example, these areas of interest 
contain events of interest and there is a risk of a channel reaching its capacity. Thus in 
the unlikely event of several cameras transmitting data at the same lime, a monitor may 
be adapted to receive images from more than one camera at the same time, for example, 
by reconfiguring a scream into two or more sections. Alternatively an image store, such 

15 as a buffer, may be provided. The image store enables once retrieved, an image to be 
viewed at a different time from another. 

Means is preferably also provided to determine which portion of the data is useful and 
which portion of the data is superfluous, such as static objects. Advantageously means 
20 is provided to encode data to be transmitted in for example, MPEG 4 format, so as to 
reduce the amount of transmitted data. 

The means to obtain information preferably includes a charge couple device (CCD) and 
a microprocessor, frame store, and/or dedicated circuits such as ASIC's, to discriminate 
25 pixel features. The said microprocessor and ASIC's may be configurable and 
programmable, and may be able to communicate with other cameras via one or more 
communication channels. 

Actuator means for displacing the field of view of the camera may be provided- The 
30 actuator means may be operated under control of a microprocessor which is arranged to 
displace the camera so that objects of interest are maintained within a field of view. 



4 

Artificial intelligence, for example in the fonn of a neural network, may be included 
in the system. 

In order to increase channel carrying capacity means may be provided to discriminate 
moving portions of an image and image portions occupied by objects. Discriminating 
moving portions of an image may be implemented by a motion detector using 
consecutive images. Discriminating image portions occupied by an objects may be 
implemented by object detector using an adopted reference image containing only 
background image information. 

Means may also be provided to detect movement direction, or main direction of 
movement if there are multiple directions in the view of camera, so that the camera may 
be adapted to follow or track the moving object/objects. 

Embodiments of the invention will now be described, by way of example only, and with 
reference to the Figures, in which: 

Figure 1 shows a block diagram of an example of a camera in accordance with the 
invention; 

Figure 2 shows a functional block diagram of a camera processing unit; 

Figure 3 shows a block diagram of a moving edge detector which is incorporated into 
the camera to detect moving objects; 

Figure 4 shows a block diagram of an object detector; and 

Figure 5 is an overall view of a system including four cameras. 

Figure 1 shows a block diagram of a camera 2, which includes Processing Unit 10 and 
MPEG 4 encoder 4, An actuator 8 is provided to move camera 2 in a controlled 
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manner, eg, by tilling, panning or zooming. Processing unit 10 is shown in ^ater 
detail in Figure 2. 

Referring to Figure I, camera 2 has a lens 6 and an image detector which is preferably a 
5 charge coupled device (CCD). Outputs of camera 2 are a transmission Request Signal, 
to request a transmitter to transmit data when there is an event detected and Tracking 
Control signal, to control actuator 8 to follow event movement. Whole Image is the 
same image as obtained from a normal camera. Area of Interest (AOI) Image outputs 
images in area of interest, MPEG 4 Image outputs MPEG 4 encoded images of an AOI 
10 Image, 

Operation of the camera will now be described, with reference to Figure 2. Referring to 
Figure 2, three frames of sequential video images 11 are stored in ihree frame stores, 
FSl 21, FS2 22 and FS3 23. Using the three images, a moving edge detector 31 detects 

15 moving edges in an image and generates a moving edge image. A reference image 32 
containing only background image data is used to compare with sequential images in 
order to detect whether objects are present in the camera's field of view. The reference 
image may automatically be adopted whenever there is not an object detected so as to 
overcome the problem of change of ambient lighting conditions. By comparing a 

20 reference image 32 with images from FS2 22, the object detector 33 detects whether or 
not there are events of interest present in the images- 
Using the information inherent in moving edge images, and of objects detected, three 
features can be detected. These are: events of interest, directions of moving Objects and 

25 areas of interest. Detection is by way of high level of analysis. Interest Analyser 43 
estimates whether there is an event of interest in the field of view. This may be an 
object/or person present, or just a static background. From the event of interest detected, 
means for decision making 50 determines when or which images are to be transmitted. 
Area of interest (AOI) analyser 42 measures an area of interest in the image in the 

30 region where an event of interest is detected. Thus, only data in AOI is transmitted. 
Other parts of the image are ignored as they are relatively static and therefore discarded. 
Thus bandwidth is saved. By using the technique of block matching, direction analyser 
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41 detects an overall direction of movement of the event. This infonnation 
may be used to control an actuator so that if present, actuator 15 controls camera 2 in 
order to follow an event of interest. 

5 From the three variables: events of interest, directions of moving objects and areas of 
interest, decision making means 50 generates three signals. A, B and C. Signal A 
informs image buffer 60 to be ready to send an image and which part of the image is to 
be sent- Signal B requests transmitter to transfer images by overriding any existing 
channel. Signal C controls camera 10 in Figure 1 so that it tracks the events of interest if 
10 necessary, by dlt, pan or zoom. The image is then encoded by MPEG 4 encoder and 
transmitted either via a hardwire (fibre opdc) connection or as an rf, VHF or UHF 
signal. 

Moving edge detector is illustrated diagrammatically in Figure 3. Three consecutive 
15 images of sequential video images 11 are stored in three frame stores, FSi 2i» FS2 22 
and FS3 23, and used for moving edge detection. Ij (x,y), hjx^y) and I3 (x,y) denote the 
three consecutive images respectively. The input of Edge Detection 32 is h (x, y) and its 
output is Ej[x,y) is an edge image from image li(x,y). Inputs of temporal difference (1) 
31 are li(x,y) and l^(x,y), and output is a difference image Dj2(x,y) which is defined as 
20 the following equation; 

D;26t,y;= i Ii (x,y) . I,(x,y) I Eqn (1) 

25 The inputs of temporal difference (2) 33 are (x, y) and I3 (x, y), and its output is a 
difference image D,^ (x, y) which is defined in equation 2 as the follows; 

D23(x,y) = I I,(?c,y)- l3(x,y) I Eqn (2) 

30 

The inputs of Multiplication 41 are Di2(xjl EJx^y) and D^Jxj) and its output M{x,y) is 
calculated as the follows: 
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M(x.y)^ Dn(x,yyE2(x,ylDJx^y) Eqn (3) 
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5 The output of threshold device 42 is the moving edge image ME(x,y) 12, which is 
defined as follows: 



ME(x,y) = 



Mix,y)JfM{x,y)>Tm 

Eqn (4) 

O.Othenvise 



where Tm is a threshold for moving edge detection. 



An example of object detector is illustrated in Figure 4. Frame store FS2 21 contains the 
input image 11, which is one of the sequential images of camera 2 and may contain 

15 objects. Reference Image 22 is a frame store containing a reference image which 
contains only background image. The reference image may automadcally be adopted by 
input image 1 1 whenever there is not an object detected in the image. Thus, the problem 
of changes in light intensity can be overcome. Let I2 (x,y) and R(x, y) denote the image 
in FS2 and the reference image respectively. By comparing I2 (x, y) and R(x, y), the 

20 Intensity Subtraction 23 generates a difference image D(x,y), which is calculated as the 
follows: 

D(x, y) =^\h (x,y) - R(x. y) I Eqn (5) 

25 Then, using a technique of thresholding, the output 0(x,y) of thresholding means 31 is 
defined as follows: 



(Ufd(x,y)>To 
0{x,y)^< Eqn (6) 



30 
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where 1 indicates that the pixel is an object pixel, 0 indicates thai the pixel is a 
background pixel, and To threshold for object detection. 

Through analyser 32, the output signal 12 indicates whether an object or objects have 
been detected. 

Figure 5 is a diagramatical overall view of a system 100 including four cameras lOOA, 
B, C and D. Cameras 100 A and B are connected to a monitoring station 104 via hard 
wire connectors. Cameras lOOC and D are connected to monitoring station 104 via rf 
transmitters 106C and 106D and via rf receiver 108. 

Monitoring station 104 is connected to a plurality of monitors 1 10 of which only one is 
shown. The screen 1 12 of the monitor is capable of being divided into four sections and 
images from one or more cameras displayed in the or each section. 

The invention has been described by way of examples only and variation may be made 
to the embodiments described without departure from the scope of the invention. 



CLAIMS 



A camera having means for determining whether infoixnation detected in its 
field of view includes a moving object; processing means for determining 
whether said moving object exceeds a predetermined threshold: and means for 
transmitting at least a portion of said moving image to a remote location. 

A camera according to claim 1 wherein the means for transmiuing at least a 
portion of said moving image is a radio frequency (rf) transmitter. 

A camera according to claim I or 2 wherein the camera has an actuator arranged 
to tilt, pan or zoom, 

A camera according to claim 1. 2 or 3 wherein at least one motion sensor is 
included so that images are transmitted only if movement is detected. 

A Closed Circuit Television (CCTV) Camera and System including a plurality 
of CCTV cameras and a communication channel from each of said cameras to at 
least one monitor; characterised in that means is provided at a camera to obtain 
information indicative of displacement of an object in the camera's field of view 
and processing means is provided to determine whether said information 
exceeds a predetermined threshold, whereby if said threshold is exceeded an 
override signal is generated, which override signal switches a monitor to receive 
from said camera. 

A system according to claim 5 wherein the means to obtain information includes 
a charge coupled device (CCD) and a microprocessor arranged to discriminate 
between static and moving pixels or moving portions of an image. 
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A system according to claim 5 including artificial intelligence, for example* in 
the form of a neural network. 

A method of transmitting image data, obtained by a camera, to a remote 
location, comprising the steps of: determining whether an object, in the field of 
view of the camera, is moving and if so whether ii exceeds a predetermined 
threshold; generating an override signal if said threshold is exceeded, 
transmitting at least a portion of the image data with the override signal to a 
remote location; said override signal being configured so as to switch a monitor, 
at the remote location, to display said portion of image. 
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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney (Sole Inventor) 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe that I am the original, first and sole inventor of the subject matter which is claimed 

and for which a patent is sought on the invention entitled Closed circuit 

television (CCTV) camera and system ^ 



the specification of which; Q is being filed herewith. 

[x] was filed on 06 September 2001 

I hereby state that I have reviewed and understand the contents of the above identified 
specification, including the claims, as amended by an amendment, if any, specifically referred to 
in this oath or declaration. 

I acknowledge the duty to disclose all information known to me which is material to 
patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, 119 of any 
foreign application(s) for patent or inventor's certificate listed below and have also identified 
below any foreign application for patent or inventor's certificate having a filing date before that 
of the apphcation on which priority is claimed: 



I hereby claim the benefit under Title 35, United States Code, 120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States application in the manner provided by the 
first paragraph of Title 35, United States Code, 112, I acknowledge the duty to disclose all 
information known to me to be material to patentability as defined in Title 37, Code of Federal 
Regulations, 1.56 which became available between the filing date of the prior application and the 
national or PCT intemational filing date of this application: 



-2- 



ATTY DOCKET NO. 




I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 

I hereby appoint the following attorneys with full power of substitution and revocation, to 
prosecute said application, to make alterations and amendments therein, to receive the patent, and 
to transact all business in the Patent and Trademark Office connected therewith: 

William H. BoUman QReg. No. 36,457) 

W. Warren TaltavuU (Reg. No. 25,647) 

Edward J. Stemberger (Reg. No. 36,017) 
Jeffrey S. Melcher (Reg. No. 35,950) 

Leon R. Turkevich ' (Reg. No. 34,035) 
Paul E. White, Jr. (Reg. No. 32,011) . 

Please address all correspondence to: 

William H. BoIIman 
MANELLI DENISON & SELTER PLLC 
2000 M Street, N.W. Suite 700 
Washington. DC 20036-3307 
TEL; (202)261-1000 
F AX: (202)887-0336 

Please direct all telephone calls to: 

William H. Bollman^t ( 202) 261-1020. 

Full name of sole inventor: Jia Hong Yin 

Inventor's signatur e^^^^^^^^^^^^^^^^^^^ ^ Date: f'^^/f j 

Residence: Fulham, Condoa>.,SWy 2RW, England <S'6>>^ 

Citizenship: British 

Post Office Address: 3 Watermeadow Lane, Fulham, London, SW6 2RW, England 



